Hierarchical Dirichlet process and relative entropy
نویسندگان
چکیده
The Hierarchical Dirichlet process is a discrete random measure serving as an important prior in Bayesian non-parametrics. It motivated with the study of groups clustered data. Each group modelled through level two and all share same base distribution which itself drawn from one process. has concentration parameters at each level. main results paper are law large numbers deviations for hierarchical its mass when both converge to infinity. deviation rate functions identified explicitly. function consists terms corresponding relative entropies less than process, reflects fact that number clusters under slower growth
منابع مشابه
Spike train entropy-rate estimation using hierarchical Dirichlet process priors
Entropy rate quantifies the amount of disorder in a stochastic process. For spiking neurons, the entropy rate places an upper bound on the rate at which the spike train can convey stimulus information, and a large literature has focused on the problem of estimating entropy rate from spike train data. Here we present Bayes least squares and empirical Bayesian entropy rate estimators for binary s...
متن کاملHierarchical Relative Entropy Policy Search
Many reinforcement learning (RL) tasks, especially in robotics, consist of multiple sub-tasks that are strongly structured. Such task structures can be exploited by incorporating hierarchical policies that consist of gating networks and sub-policies. However, this concept has only been partially explored for real world settings and complete methods, derived from first principles, are needed. Re...
متن کاملHybrid Parallel Inference in Hierarchical Dirichlet Process
The hierarchical Dirichlet process (HDP) can provide a nonparametric prior for a mixture model with grouped data, where mixture components are shared across groups. However, the computational cost is generally very high in terms of both time and space complexity. Therefore, developing a method for fast inference of HDP remains a challenge. In this paper, we assume a symmetric multiprocessing (S...
متن کاملMultimodal Hierarchical Dirichlet Process-based Active Perception
In this paper, we propose an active perception method for recognizing object categories based on the multimodal hierarchical Dirichlet process (MHDP). The MHDP enables a robot to form object categories using multimodal information, e.g., visual, auditory, and haptic information, which can be observed by performing actions on an object. However, performing many actions on a target object require...
متن کاملEvolutionary Hierarchical Dirichlet Process for Timeline Summarization
Timeline summarization aims at generating concise summaries and giving readers a faster and better access to understand the evolution of news. It is a new challenge which combines salience ranking problem with novelty detection. Previous researches in this field seldom explore the evolutionary pattern of topics such as birth, splitting, merging, developing and death. In this paper, we develop a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Communications in Probability
سال: 2023
ISSN: ['1083-589X']
DOI: https://doi.org/10.1214/23-ecp511